United States Patent and Trademark Ofhce 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark OtBce 

Address: COMMISSIONER FOR PATENTS 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. CONFIRMATION NO. 



10/534,661 



11/10/2005 



45209 7590 11/30/2009 

intel/bstz 

BLAKELY SOKOLOFF TAYLOR & ZAFMAN LLP 
1279 OAKMEAD PARKWAY 
SUNNYVALE, CA 94085-4040 



GUERRA-ERAZO, EDGAR X 



PAPER NUMBER 



DELIVERY MODE 



Please find below and/or attached an Office communication concerning this application or proceeding. 

The time period for reply, if any, is set in the attached communication. 



PTOL-90A (Rev. 04/07) 



KJtSiVrXS nvrliyjts OUff Iff fcff Jr 


Application No. 

10/534,661 


Applicant(s) 

HE, LIANG 


Examiner 

EDGAR GUERRA-ERAZO 


Art Unit 
2626 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
eamed patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )^ Responsive to communication(s) filed on 09 October 2009 . 
2a )□ This action is FINAL. 2b)|3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 7-49 is/are pending in the application. 

4a) Of the above claim(s) 2,3,5, 7,9, 1 1-13. 15-34.36.37 and 39-44 is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) |EI Claim(s) 1.4.6.8. 10. 14.35.38 and 45-49 is/are rejected. 
/)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)^ accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held In abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attach ment(s) 

1 ) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO/SB/08) 5) □ Notice of Informal Patent Application 

Paper No(s)/Mail Date . 6) □ Other: . 

'TOL-326 (Rev. 08-06) Office Action Summary Part of Paper No./Mail Date 20091 1 1 9 



Application/Control Number: 10/534,661 Page 2 

Art Unit: 2626 

DETAILED ACTION 
Response to Amendment 

1 . In response to the ofRce action from 07/10/2009, the Applicant has submitted a Request 
for Continued Examination, amending Claims 1, 35 and 45, (Amendment, Pages 8-10). 

2. In response to the cancellation of Claim 37, the Examiner has withdrawn the previous 
claim objection directed towards improper dependency. 

3. Applicant's arguments have been fiilly considered but are moot in view of the new 
ground(s) of rejection. 



Continued Examination Under 37 CFR 1.114 

4. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 10/09/2009 has been entered. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1, 4, 6, 8, 10, 14, 35, 38, 45-49 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kuansan et al. (EP 1 255 194) in view of Gottfurcht et al. (U.S. Patent: 



Application/Control Number: 10/534,661 Page 3 

Art Unit: 2626 

7,020,845), and further in view of Polcyn (U.S. Patent: 6,865,258), hereinafter referred to as 
Kuansan, Gottfurcht and Polcyn. 

With respect to Claims 1, 35, 45, Kuansan discloses: 

A method, machine-readable medium having instructions which when executed cause a machine 

to, and system comprising: 

interpreting user input received at a client mobile device from a user (the object mode provides 
eventing and scripting and can offer greater functionality to give the dialog author a much finer 
client-side control over speech interactions, paragraph [0043]), the interpreting including 
identifying a selection of at least one of a plurality of web interaction modes (use of speech 
recognition in conjunction with at least a display, further this form of entry using both a screen 
display allowing free from selection of fields and voice recognition is called "multimodal, " 
paragraph [0045], Fig. 6), each of the plurality of web interaction modes to perform 
interpretation of content on a server computer system and a client mobile device coupled with 
the server computer system (voice recognition from audible signals transmitted by phone 80 are 
provided from voice browser 216 to recognition server 204, either through the network 205, or 
through a dedicated line 207, for example, using TCP/IP Web server 202, paragraph [0035]). 

Although Kuansan discloses how the event "onClick" is initiated which calls or executes 
function "talk" in script portion 272, further this action activates a grammar used for speech 

recognition that is associated with the type of data generally expected in field 250, (paragraphs 
[0046]); telephone. Record (url, endSilence, [maxTimeout], [initialTimeout], (section 5.2.6, 
Appendix); and "use of speech recognition in conjunction with at least a display, further this 
form of entry using both a screen display allowing free from selection of fields and voice 
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recognition is called "multimodal," (paragraph [0045], Fig. 6), Kuasan does not explicitly 
disclose the limitations the plurality of web interaction modes including a focus mechanism; 
identifying, via the focus mechanism, an active display element and applying the user input to 
the active display element , and focusing the client mobile device on the active display element 

receiving, at the server computer system. Gottfiircht, however, discloses the plurality of web 
interaction modes including a focus mechanism ("...some embodiments of the invention will 
include speech to text (STT) capability 130 and speech recognition (SR) capablitiy 136... ", Col. 
4, lines 19-43; "...If the identification has been received, the corresponding region is brought 
into focus... desirable for web browsing. ..a first link in the focus region is highlighted... ", Col. 5, 
lines 17-47); 

identifying, via the focus mechanism, an active display element and applying the user input to 
the active display element ("...If the identification has been received, the corresponding region 
is brought into focus... If a tab input is received, the next region is brought into focus... a first 
link in the focus region is highlighted.. A determination is made at decision block 466 if an 
enter signal has been received.. Jf an enter signal is received at functional block 466, a then 
highlighted link is activated at functional block 474 and the next segmented page is received, 
and the process begins again... ", Col. 5, lines 17-67), and focusing the client mobile device on 
the active display element (" ...node 12 might be a set top box and television, or an internet 
appliance, or a wireless device, such as a web enabled cell phone... ", Col. 2, lines 25- 
41 "...Remote control 504 may be equipped with a microphone for accepting voice 
commands... Link one is highlighted and A is enlarged, while the remaining regions are scaled 
...a second link in region A is highlighted... ", Col. 5, line 59- Col. 6, line 23; " ...personal 
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computer (PC) ...system employing... wide-area network (WAN) 10, such as the Internet, couples 
together a plurality of communication nodes... server nodes connected to WAN 10, such as server 
node 16 which may be any conventional web server... ", Col. 2, lines 20-41, Figs. 5A-5C). 

Kuansan and Gottfurcht are analogous art because they are from a similar field of 
endeavor in facilitating improved web accesses applications. Thus, it would have been obvious 
to a person of ordinary skill in the art, at the time of invention, to modify the teachings of 
Kuansan with the once received identification, having the corresponding region brought into 
focus. . .desirable for web browsing. . .a first link in the focus region is highlighted... taught by 
Gottfurcht in order to provide a simplified and easier navigation to facilitate usability access to 
services and at same time improved web access through a television display, internet appliance, 
and wireless devices, (Col. 1, lines 14-17, Col. 4, lines 60-65). 

Furthermore, Kuansan in view of Gottfurcht do not explicitly disclose the amended 
limitations transmitting the active display element to the server computer system such that 
real-time speech recognition is performed based on synchronization of the active display 
element with one or more speech elements of speech, the speech recognition to reduce 
speech computing load and eliminate speech dictation; and dynamically correcting 
grammar using the real-time speech recognition based on the synchronization of the active 
display element and the one or more speech elements . Polcyn, however, discloses the 
amended limitations transmitting the active display element to the server computer system 
such that real-time speech recognition ("...a transcription interface application may be 
executing on the transcriber's computer terminal (e.g., PC) or some other remote or local server 
to present data entry screen 302 to the transcriber on the transcriber's computer terminal. 
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Additionally, in a preferred embodiment, the transcription interface application may 
automatically transcribe the data provided in message 320. For instance, a voice recognition 
application may be utilized to convert the audio data of message 320 to textual format... ", Col. 
12, Lines 54-65, Col. 8, Lines 7-32, Figs. 1, 3 and 4) is performed based on synchronization of 
the active display element with one or more speech elements of speech, the speech 
recognition to reduce speech computing load and eliminate speech dictation ("...the 
presentation of the data from the message may be automatically synchronized with the 
transcriber's activity. As used herein, "presentation" of message data is intended to refer to 
audibly playing audio data, displaying image data, as well as any other method of presenting 
various types of data which a message may comprise... ", Col. 15, Lines 32-50, Col. 5, Lines 1- 
11, Figs. 1, 3 and 4) : and dynamically correcting grammar using the real-time speech 
recognition based on the synchronization of the actiye display element and the one or more 
speech elements {"...the transcription interface may monitor the transcriber's activity and 
automatically adjust the presentation of data to be transcribed according to such activity. For 
example, the transcription interface may monitor the transcriber's focus, e.g., by determining the 
location of the cursor, and the interface may automatically adjust the presentation of data to 
correspond with such focus... ", "...error detection/correction tools can be included within the 
user interface to further assist the transcribing agent. For example, potential grammar problems 
and/or misspellings may be highlighted or automatically corrected... ", Col. 12, Lines 18-29, 
Col. 17, Lines 21-28, Col. 16, Lines 61-65, Col. 14, Line 60-Col. 15, Line 15, Figs. 1, 3 and 4). 

Kuansan, Gottfurcht and Polcyn are analogous art because they are from a similar field of 
endeavor in facilitating improved web transcription systems. Thus, it would have been obvious 
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to a person of ordinary skill in the art, at the time of invention, to modify the teachings of 
Kuansan in view of Gottfijrcht with the enhanced transcription system taught by Polcyn in order 
to advantageously synchronize automatically a message presentation with transcriber's activity 
for such message. . .further to increase efficiency of a transcriber by eliminating the time 
required. . .for manually adjusting/controlling presentation of a message, (Col. 5, Lines 1-11). 

With respect to Claims 4 and 38, Kuansan further discloses: 
wherein the focused display element comprises a hyperlink or a field in a form (telephony voice 
browser 212 receives HTML pages/scripts or the like from web server 202, paragraph [0035]; 
the credit card information includes a field 250 for entry of the type of credit card being used, 
paragraph [0039]). 

Also, Gottfurcht discloses ". . .some embodiments of the invention will include speech to 
text (STT) capability 130 and speech recognition (SR) capablitiy 136. . .", (Col. 4, lines 19-43); 
". . .If the identification has been received, the corresponding region is brought into 
focus. . .desirable for web browsing. . .a first link in the focus region is highlighted...", (Col. 5, 

lines 17-47). 

With respect to Claims 6 and 46, Kuansan fiirther discloses: 

fiirther including: extracting speech features from the user input, and generating a client 

mobile device request based in part on the extracted speech features (particular mode of entry, 
use of speech recognition with at least a display, further a screen display allowing free from 
selection of fields and voice recognition, paragraph [0045]). 
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Also, Gottfurcht discloses ". . .node 12 might be a set top box and television, or an 
internet appliance, or a wireless device, such as a web enabled cell phone. . .", (Col. 2, lines 25- 
41); ". . .Remote control 504 may be equipped with a microphone for accepting voice 
commands... Link one is highlighted and A is enlarged, while the remaining regions are scaled 
...a second link in region A is highlighted. . .", (Col. 5, line 59- Col. 6, line 23); ". . .personal 
computer (PC). . .system employing. . .wide-area network (WAN) 10, such as the Internet, 
couples together a plurality of communication nodes. . .server nodes connected to WAN 10, such 
as server node 16 which may be any conventional web server. . .", (Col. 2, lines 20-41, Figs. 5A- 
5C). 

With respect to Claims 8 and 47, Kuansan further discloses: 

fiirther including: receiving a session message at the server computer system to initialize 
a connection between the server computer system and the client mobile device, wherein the 

session message includes an internet protocol (IP) address of the client mobile device, a device 
type of the client mobile device, a voice character of a user responsible for the user input, a 
language of the user input, and a defauk recognition accuracy requested by the client mobile 
device (the Recognition element can include a "mode" attribute to distinguish the following 
three modes of recognition, which instruct the recognition server 204 how and when to return 
the results, paragraph [0053]); various attribute of the Reco element control behavior of the 
recognition server 204, further the attribute "initial-Timeout" 289 is the time between the start 
of recognition 283 and the detection of speech 285, paragraph [0055] ; caller's IP address, 
(Apendix, Section 5.1 Properties); markup language page on the client device, ( paragraph 
[0034]); (input data indicative of speech, DTMF, handwriting, gestures or images obtained from 
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the user, paragraph [0034]); instruction indicating a grammar to associate with the input data 
entered through the client device, paragraph [0035]); the return of results implies providing the 
"onReco " event or activating the "blind" elements as appropriate, further if the mode is 
unspecified, the default recognition mode can be "automatic", paragraph [0053]). 

With respect to Claims 10 and 48, Kuansan further discloses: 
further including: receiving a transmission message at the server to exchange 
transmission parameters between the server computer system and the client mobile device (using 
wireless transceiver 52 or communication interface 60, speech data is transmitted to a remote 
recognition server 204, further recognition results are then returned to mobile device 30 for 
rendering, paragraph [0016]). 

Also Gottfurcht discloses ". . .the processor 100 will communicate thorugh the trsnaciever 
124 to the server using transmission control protocol/internet protocol (TCP/IP). Encryption and 
compression within the terminal may be handled by conventional hardware or software 
solutions...", (Col. 4, lines 4-18); ". . .there are fifteen cells that represent navigation options and 
one messaging cell for displaying messages from the server, the progress bar or status bar. . .", 
(Col. 8, lines 4-9). 

With respect to Claims 14 and 49, Kuansan fiirther discloses: 

further including: receiving an exit message at the server computer system to terminate a 
user session with the server computer system and the chent mobile device (telephone.HangupQ 
instruction terminating call in progress, section 5.2.4 Appendix). 
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Also Gottfurcht discloses ". . .the processor 100 will communicate thorugh the trsnaciever 
124 to the server using transmission control protocol/internet protocol (TCP/IP). Encryption and 
compression within the terminal may be handled by conventional hardware or software 
solutions...", (Col. 4, lines 4-18); ". . .there are fifteen cells that represent navigation options and 
one messaging cell for displaying messages from the server, the progress bar or status bar. . .", 
(Col. 8, lines 4-9). 



Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. See PTO-892 Form. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Edgar Guerra-Erazo whose telephone number is (571) 270-3708. 
The examiner can normally be reached on M-F 7:30a.m.-5 :00p.m. EST. If attempts to reach the 
examiner by telephone are unsuccessfiil, the examiner's supervisor, David Hudspeth can be 
reached on (571) 272-7843. The fax phone number for the organization where this application or 
proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
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system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you 
would like assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Edgar Guerra-Erazo/ 
Examiner, Art Unit 2626 

/David R Hudspeth/ 



Supervisory Patent Examiner, Art Unit 2626 



